Pandas Profiling Report

Dataset statistics

Number of variables	17
Number of observations	100000
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	13.0 MiB
Average record size in memory	136.0 B

Variable types

Numeric	15
Categorical	2

Alerts

`rerun_ID` has constant value "301"	Constant
`MJD` is highly overall correlated with `g` and 5 other fields	High correlation
`class` is highly overall correlated with `redshift`	High correlation
`g` is highly overall correlated with `MJD` and 7 other fields	High correlation
`i` is highly overall correlated with `MJD` and 7 other fields	High correlation
`plate` is highly overall correlated with `MJD` and 5 other fields	High correlation
`r` is highly overall correlated with `MJD` and 7 other fields	High correlation
`redshift` is highly overall correlated with `class` and 4 other fields	High correlation
`spec_obj_ID` is highly overall correlated with `MJD` and 5 other fields	High correlation
`u` is highly overall correlated with `g` and 2 other fields	High correlation
`z` is highly overall correlated with `MJD` and 6 other fields	High correlation
`u` is highly skewed (γ1 = -313.8492424)	Skewed
`g` is highly skewed (γ1 = -314.2766946)	Skewed
`z` is highly skewed (γ1 = -314.7594188)	Skewed
`spec_obj_ID` has unique values	Unique

Reproduction

Analysis started	2025-02-25 22:37:05.346203
Analysis finished	2025-02-25 22:37:34.215073
Duration	28.87 seconds
Software version	ydata-profiling vv4.12.2
Download configuration	config.json

alpha
Real number (ℝ)

Distinct	99999
Distinct (%)	> 99.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	177.62912

Minimum	0.0055278279
Maximum	359.99981
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	781.4 KiB

Quantile statistics

Minimum	0.0055278279
5-th percentile	11.750808
Q1	127.51822
median	180.9007
Q3	233.895
95-th percentile	348.76982
Maximum	359.99981
Range	359.99428
Interquartile range (IQR)	106.37678

Descriptive statistics

Standard deviation	96.502241
Coefficient of variation (CV)	0.54327941
Kurtosis	-0.5371908
Mean	177.62912
Median Absolute Deviation (MAD)	53.2025
Skewness	-0.028510865
Sum	17762912
Variance	9312.6825
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
34.74960002	2	< 0.1%
135.6891066	1	< 0.1%
122.7363106	1	< 0.1%
28.44961333	1	< 0.1%
216.3553482	1	< 0.1%
337.1751199	1	< 0.1%
304.8549412	1	< 0.1%
119.2801296	1	< 0.1%
258.089669	1	< 0.1%
256.7709465	1	< 0.1%
Other values (99989)	99989	> 99.9%

Value	Count	Frequency (%)
0.005527827924	1	< 0.1%
0.01095869374	1	< 0.1%
0.01168374605	1	< 0.1%
0.01333666183	1	< 0.1%
0.0229663342	1	< 0.1%
0.02425788497	1	< 0.1%
0.02461910532	1	< 0.1%
0.02571591573	1	< 0.1%
0.02720599703	1	< 0.1%
0.02893798287	1	< 0.1%

Value	Count	Frequency (%)
359.9998098	1	< 0.1%
359.9996152	1	< 0.1%
359.9990313	1	< 0.1%
359.9989651	1	< 0.1%
359.9970063	1	< 0.1%
359.9941245	1	< 0.1%
359.9936716	1	< 0.1%
359.9935681	1	< 0.1%
359.9893865	1	< 0.1%
359.9863626	1	< 0.1%

delta
Real number (ℝ)

Distinct	99999
Distinct (%)	> 99.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	24.135305

Minimum	-18.785328
Maximum	83.000519
Zeros	0
Zeros (%)	0.0%
Negative	12061
Negative (%)	12.1%
Memory size	781.4 KiB

Quantile statistics

Minimum	-18.785328
5-th percentile	-2.3656696
Q1	5.1467709
median	23.645922
Q3	39.90155
95-th percentile	56.701075
Maximum	83.000519
Range	101.78585
Interquartile range (IQR)	34.754779

Descriptive statistics

Standard deviation	19.644665
Coefficient of variation (CV)	0.81393899
Kurtosis	-1.0430622
Mean	24.135305
Median Absolute Deviation (MAD)	17.268085
Skewness	0.17507856
Sum	2413530.5
Variance	385.91288
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-0.6019312345	2	< 0.1%
32.49463184	1	< 0.1%
37.97318516	1	< 0.1%
6.153946054	1	< 0.1%
45.3358889	1	< 0.1%
4.94093746	1	< 0.1%
-11.90668825	1	< 0.1%
22.38564551	1	< 0.1%
24.85135128	1	< 0.1%
26.47819984	1	< 0.1%
Other values (99989)	99989	> 99.9%

Value	Count	Frequency (%)
-18.78532808	1	< 0.1%
-17.63619832	1	< 0.1%
-17.61305644	1	< 0.1%
-17.57382002	1	< 0.1%
-17.46539063	1	< 0.1%
-17.45139007	1	< 0.1%
-17.4339462	1	< 0.1%
-17.36304673	1	< 0.1%
-17.28479137	1	< 0.1%
-17.22626675	1	< 0.1%

Value	Count	Frequency (%)
83.00051859	1	< 0.1%
82.94762183	1	< 0.1%
82.81603025	1	< 0.1%
82.76442096	1	< 0.1%
82.75715318	1	< 0.1%
82.65631855	1	< 0.1%
82.56750029	1	< 0.1%
82.28865698	1	< 0.1%
79.34307616	1	< 0.1%
79.28929904	1	< 0.1%

u
Real number (ℝ)

High correlation Skewed

Distinct	93748
Distinct (%)	93.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	21.980468

Minimum	-9999
Maximum	32.78139
Zeros	0
Zeros (%)	0.0%
Negative	1
Negative (%)	< 0.1%
Memory size	781.4 KiB

Quantile statistics

Minimum	-9999
5-th percentile	18.43093
Q1	20.352353
median	22.179135
Q3	23.68744
95-th percentile	25.78505
Maximum	32.78139
Range	10031.781
Interquartile range (IQR)	3.3350875

Descriptive statistics

Standard deviation	31.769291
Coefficient of variation (CV)	1.4453419
Kurtosis	98998.365
Mean	21.980468
Median Absolute Deviation (MAD)	1.666855
Skewness	-313.84924
Sum	2198046.8
Variance	1009.2878
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
24.63465	77	0.1%
24.63466	64	0.1%
24.63467	44	< 0.1%
24.63464	23	< 0.1%
24.63468	20	< 0.1%
24.63463	5	< 0.1%
24.63469	4	< 0.1%
24.26353	4	< 0.1%
24.63462	4	< 0.1%
20.59248	4	< 0.1%
Other values (93738)	99751	99.8%

Value	Count	Frequency (%)
-9999	1	< 0.1%
10.99623	1	< 0.1%
12.10168	1	< 0.1%
12.2624	1	< 0.1%
12.30349	1	< 0.1%
12.99664	1	< 0.1%
13.89799	1	< 0.1%
13.94716	1	< 0.1%
14.14713	1	< 0.1%
14.15199	1	< 0.1%

Value	Count	Frequency (%)
32.78139	1	< 0.1%
30.66039	1	< 0.1%
29.32565	1	< 0.1%
29.23438	1	< 0.1%
29.19901	1	< 0.1%
29.18637	1	< 0.1%
29.04068	1	< 0.1%
28.90174	1	< 0.1%
28.79676	1	< 0.1%
28.77812	1	< 0.1%

g
Real number (ℝ)

High correlation Skewed

Distinct	92651
Distinct (%)	92.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	20.531387

Minimum	-9999
Maximum	31.60224
Zeros	0
Zeros (%)	0.0%
Negative	1
Negative (%)	< 0.1%
Memory size	781.4 KiB

Quantile statistics

Minimum	-9999
5-th percentile	17.07282
Q1	18.96523
median	21.099835
Q3	22.123767
95-th percentile	23.408262
Maximum	31.60224
Range	10030.602
Interquartile range (IQR)	3.1585375

Descriptive statistics

Standard deviation	31.750292
Coefficient of variation (CV)	1.5464271
Kurtosis	99178.147
Mean	20.531387
Median Absolute Deviation (MAD)	1.3325
Skewness	-314.27669
Sum	2053138.7
Variance	1008.0811
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
25.11438	9	< 0.1%
25.11439	9	< 0.1%
25.11437	8	< 0.1%
20.98246	4	< 0.1%
22.56372	4	< 0.1%
22.03644	4	< 0.1%
20.4269	4	< 0.1%
21.94795	4	< 0.1%
21.65138	4	< 0.1%
21.40104	4	< 0.1%
Other values (92641)	99946	99.9%

Value	Count	Frequency (%)
-9999	1	< 0.1%
10.4982	1	< 0.1%
10.51139	1	< 0.1%
10.6718	1	< 0.1%
10.73097	1	< 0.1%
11.33897	1	< 0.1%
11.39234	1	< 0.1%
11.47435	1	< 0.1%
11.74518	1	< 0.1%
11.79892	1	< 0.1%

Value	Count	Frequency (%)
31.60224	1	< 0.1%
30.607	1	< 0.1%
29.86258	1	< 0.1%
28.9032	1	< 0.1%
28.2066	1	< 0.1%
27.89482	1	< 0.1%
27.53211	1	< 0.1%
27.41465	1	< 0.1%
27.38851	1	< 0.1%
27.34772	1	< 0.1%

r
Real number (ℝ)

High correlation

Distinct	91901
Distinct (%)	91.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	19.645762

Minimum	9.82207
Maximum	29.57186
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	781.4 KiB

Quantile statistics

Minimum	9.82207
5-th percentile	16.393046
Q1	18.135828
median	20.12529
Q3	21.044785
95-th percentile	22.070249
Maximum	29.57186
Range	19.74979
Interquartile range (IQR)	2.9089575

Descriptive statistics

Standard deviation	1.8547597
Coefficient of variation (CV)	0.094410167
Kurtosis	-0.37615756
Mean	19.645762
Median Absolute Deviation (MAD)	1.24741
Skewness	-0.50785843
Sum	1964576.2
Variance	3.4401335
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
24.80203	21	< 0.1%
24.80202	15	< 0.1%
24.80204	7	< 0.1%
20.72245	6	< 0.1%
20.74657	5	< 0.1%
20.76527	5	< 0.1%
20.64847	4	< 0.1%
21.49762	4	< 0.1%
20.28744	4	< 0.1%
19.61753	4	< 0.1%
Other values (91891)	99925	99.9%

Value	Count	Frequency (%)
9.82207	1	< 0.1%
10.06854	1	< 0.1%
10.11604	1	< 0.1%
10.1946	1	< 0.1%
10.80343	1	< 0.1%
10.86379	1	< 0.1%
10.98255	1	< 0.1%
11.09069	1	< 0.1%
11.35229	1	< 0.1%
11.64166	1	< 0.1%

Value	Count	Frequency (%)
29.57186	1	< 0.1%
29.37411	1	< 0.1%
27.62688	1	< 0.1%
27.59332	1	< 0.1%
27.39709	1	< 0.1%
27.33476	1	< 0.1%
27.30005	1	< 0.1%
27.07122	1	< 0.1%
27.06348	1	< 0.1%
26.79265	1	< 0.1%

i
Real number (ℝ)

High correlation

Distinct	92019
Distinct (%)	92.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	19.084854

Minimum	9.469903
Maximum	32.14147
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	781.4 KiB

Quantile statistics

Minimum	9.469903
5-th percentile	16.043819
Q1	17.732285
median	19.405145
Q3	20.396495
95-th percentile	21.607623
Maximum	32.14147
Range	22.671567
Interquartile range (IQR)	2.66421

Descriptive statistics

Standard deviation	1.7578948
Coefficient of variation (CV)	0.092109417
Kurtosis	-0.23484446
Mean	19.084854
Median Absolute Deviation (MAD)	1.218725
Skewness	-0.40416674
Sum	1908485.4
Variance	3.0901941
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
24.36181	6	< 0.1%
24.3618	6	< 0.1%
18.63308	5	< 0.1%
20.19353	4	< 0.1%
20.72639	4	< 0.1%
20.234	4	< 0.1%
19.95808	4	< 0.1%
19.72511	4	< 0.1%
19.52141	4	< 0.1%
20.46932	4	< 0.1%
Other values (92009)	99955	> 99.9%

Value	Count	Frequency (%)
9.469903	1	< 0.1%
10.00865	1	< 0.1%
10.05509	1	< 0.1%
10.56647	1	< 0.1%
10.87374	1	< 0.1%
10.95665	1	< 0.1%
11.26394	1	< 0.1%
11.29956	1	< 0.1%
11.31937	1	< 0.1%
11.51527	1	< 0.1%

Value	Count	Frequency (%)
32.14147	1	< 0.1%
30.25009	1	< 0.1%
30.16359	1	< 0.1%
30.1546	1	< 0.1%
29.88921	1	< 0.1%
29.85405	1	< 0.1%
27.5034	1	< 0.1%
27.18834	1	< 0.1%
26.89399	1	< 0.1%
26.30939	1	< 0.1%

z
Real number (ℝ)

High correlation Skewed

Distinct	92007
Distinct (%)	92.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	18.66881

Minimum	-9999
Maximum	29.38374
Zeros	0
Zeros (%)	0.0%
Negative	1
Negative (%)	< 0.1%
Memory size	781.4 KiB

Quantile statistics

Minimum	-9999
5-th percentile	15.778155
Q1	17.460677
median	19.004595
Q3	19.92112
95-th percentile	21.462771
Maximum	29.38374
Range	10028.384
Interquartile range (IQR)	2.4604425

Descriptive statistics

Standard deviation	31.728152
Coefficient of variation (CV)	1.6995272
Kurtosis	99381.345
Mean	18.66881
Median Absolute Deviation (MAD)	1.1716
Skewness	-314.75942
Sum	1866881
Variance	1006.6756
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
22.8269	58	0.1%
22.82691	25	< 0.1%
22.82689	25	< 0.1%
22.82692	12	< 0.1%
19.99664	4	< 0.1%
19.8872	4	< 0.1%
18.75134	4	< 0.1%
19.8066	4	< 0.1%
19.07992	4	< 0.1%
19.50887	4	< 0.1%
Other values (91997)	99856	99.9%

Value	Count	Frequency (%)
-9999	1	< 0.1%
9.612333	1	< 0.1%
10.22551	1	< 0.1%
10.44131	1	< 0.1%
10.65056	1	< 0.1%
10.77889	1	< 0.1%
10.89738	1	< 0.1%
10.91847	1	< 0.1%
11.19448	1	< 0.1%
11.30247	1	< 0.1%

Value	Count	Frequency (%)
29.38374	1	< 0.1%
28.79055	1	< 0.1%
28.23829	1	< 0.1%
27.80519	1	< 0.1%
27.67336	1	< 0.1%
26.59268	1	< 0.1%
26.42779	1	< 0.1%
26.2969	1	< 0.1%
26.13011	1	< 0.1%
26.0935	1	< 0.1%

run_ID
Real number (ℝ)

Distinct	430
Distinct (%)	0.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	4481.3661

Minimum	109
Maximum	8162
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	781.4 KiB

Quantile statistics

Minimum	109
5-th percentile	1412
Q1	3187
median	4188
Q3	5326
95-th percentile	8038
Maximum	8162
Range	8053
Interquartile range (IQR)	2139

Descriptive statistics

Standard deviation	1964.7646
Coefficient of variation (CV)	0.43842984
Kurtosis	-0.60616942
Mean	4481.3661
Median Absolute Deviation (MAD)	1134
Skewness	0.39871052
Sum	4.4813661 × 10⁸
Variance	3860299.9
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
3699	2450	2.5%
4263	2295	2.3%
3225	2275	2.3%
2964	2009	2.0%
7717	1782	1.8%
5935	1646	1.6%
7773	1630	1.6%
3926	1552	1.6%
7712	1422	1.4%
1412	1397	1.4%
Other values (420)	81542	81.5%

Value	Count	Frequency (%)
109	46	< 0.1%
211	4	< 0.1%
273	1	< 0.1%
287	1	< 0.1%
297	1	< 0.1%
307	35	< 0.1%
308	137	0.1%
745	9	< 0.1%
752	440	0.4%
756	370	0.4%

Value	Count	Frequency (%)
8162	253	0.3%
8158	10	< 0.1%
8157	104	0.1%
8156	405	0.4%
8155	8	< 0.1%
8150	13	< 0.1%
8149	11	< 0.1%
8116	211	0.2%
8115	98	0.1%
8112	45	< 0.1%

rerun_ID
Categorical

Constant

Distinct	1
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.4 KiB

301	100000

Length

Max length	3
Median length	3
Mean length	3
Min length	3

Characters and Unicode

Total characters	300000
Distinct characters	3
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	301
2nd row	301
3rd row	301
4th row	301
5th row	301

Common Values

Value	Count	Frequency (%)
301	100000	100.0%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
301	100000	100.0%

Most occurring characters

Value	Count	Frequency (%)
3	100000	33.3%
0	100000	33.3%
1	100000	33.3%

Most occurring categories

Value	Count	Frequency (%)
(unknown)	300000	100.0%

Most frequent character per category

(unknown)

Value	Count	Frequency (%)
3	100000	33.3%
0	100000	33.3%
1	100000	33.3%

Most occurring scripts

Value	Count	Frequency (%)
(unknown)	300000	100.0%

Most frequent character per script

(unknown)

Value	Count	Frequency (%)
3	100000	33.3%
0	100000	33.3%
1	100000	33.3%

Most occurring blocks

Value	Count	Frequency (%)
(unknown)	300000	100.0%

Most frequent character per block

(unknown)

Value	Count	Frequency (%)
3	100000	33.3%
0	100000	33.3%
1	100000	33.3%

cam_col
Real number (ℝ)

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.51161

Minimum	1
Maximum	6
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	781.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	4
Q3	5
95-th percentile	6
Maximum	6
Range	5
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	1.5869122
Coefficient of variation (CV)	0.45190446
Kurtosis	-1.1143049
Mean	3.51161
Median Absolute Deviation (MAD)	1
Skewness	-0.030531673
Sum	351161
Variance	2.5182904
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=6)

Value	Count	Frequency (%)
4	19573	19.6%
3	18851	18.9%
5	18537	18.5%
2	17117	17.1%
1	13227	13.2%
6	12695	12.7%

Value	Count	Frequency (%)
1	13227	13.2%
2	17117	17.1%
3	18851	18.9%
4	19573	19.6%
5	18537	18.5%
6	12695	12.7%

Value	Count	Frequency (%)
6	12695	12.7%
5	18537	18.5%
4	19573	19.6%
3	18851	18.9%
2	17117	17.1%
1	13227	13.2%

field_ID
Real number (ℝ)

Distinct	856
Distinct (%)	0.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	186.13052

Minimum	11
Maximum	989
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	781.4 KiB

Quantile statistics

Minimum	11
5-th percentile	31
Q1	82
median	146
Q3	241
95-th percentile	489
Maximum	989
Range	978
Interquartile range (IQR)	159

Descriptive statistics

Standard deviation	149.01107
Coefficient of variation (CV)	0.80057302
Kurtosis	3.703783
Mean	186.13052
Median Absolute Deviation (MAD)	74
Skewness	1.7534251
Sum	18613052
Variance	22204.3
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
71	472	0.5%
65	458	0.5%
67	449	0.4%
60	448	0.4%
69	447	0.4%
72	446	0.4%
68	445	0.4%
74	442	0.4%
81	442	0.4%
125	436	0.4%
Other values (846)	95515	95.5%

Value	Count	Frequency (%)
11	157	0.2%
12	146	0.1%
13	155	0.2%
14	182	0.2%
15	162	0.2%
16	205	0.2%
17	205	0.2%
18	235	0.2%
19	236	0.2%
20	226	0.2%

Value	Count	Frequency (%)
989	3	< 0.1%
982	1	< 0.1%
980	1	< 0.1%
979	1	< 0.1%
978	1	< 0.1%
977	1	< 0.1%
974	1	< 0.1%
971	1	< 0.1%
941	2	< 0.1%
940	3	< 0.1%

spec_obj_ID
Real number (ℝ)

High correlation Unique

Distinct	100000
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5.7838823 × 10¹⁸

Minimum	2.9951909 × 10¹⁷
Maximum	1.4126941 × 10¹⁹
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	781.4 KiB

Quantile statistics

Minimum	2.9951909 × 10¹⁷
5-th percentile	8.1865916 × 10¹⁷
Q1	2.8441376 × 10¹⁸
median	5.6148831 × 10¹⁸
Q3	8.3321441 × 10¹⁸
95-th percentile	1.1744357 × 10¹⁹
Maximum	1.4126941 × 10¹⁹
Range	1.3827422 × 10¹⁹
Interquartile range (IQR)	5.4880065 × 10¹⁸

Descriptive statistics

Standard deviation	3.3240162 × 10¹⁸
Coefficient of variation (CV)	0.57470329
Kurtosis	-0.90475989
Mean	5.7838823 × 10¹⁸
Median Absolute Deviation (MAD)	2.7303045 × 10¹⁸
Skewness	0.19846275
Sum	5.7838823 × 10²³
Variance	1.1049083 × 10³⁷
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
6.543777369 × 10¹⁸	1	< 0.1%
5.644168765 × 10¹⁸	1	< 0.1%
9.83487601 × 10¹⁸	1	< 0.1%
3.301259275 × 10¹⁸	1	< 0.1%
4.864118044 × 10¹⁸	1	< 0.1%
3.532062986 × 10¹⁸	1	< 0.1%
1.423181233 × 10¹⁸	1	< 0.1%
5.646572847 × 10¹⁸	1	< 0.1%
5.64537163 × 10¹⁸	1	< 0.1%
5.224277647 × 10¹⁸	1	< 0.1%
Other values (99990)	99990	> 99.9%

Value	Count	Frequency (%)
2.995190894 × 10¹⁷	1	< 0.1%
2.995792876 × 10¹⁷	1	< 0.1%
2.995801123 × 10¹⁷	1	< 0.1%
2.995908325 × 10¹⁷	1	< 0.1%
2.995935813 × 10¹⁷	1	< 0.1%
2.99612273 × 10¹⁷	1	< 0.1%
2.99621344 × 10¹⁷	1	< 0.1%
2.996243676 × 10¹⁷	1	< 0.1%
2.99643884 × 10¹⁷	1	< 0.1%
2.996455332 × 10¹⁷	1	< 0.1%

Value	Count	Frequency (%)
1.412694061 × 10¹⁹	1	< 0.1%
1.412693374 × 10¹⁹	1	< 0.1%
1.412693346 × 10¹⁹	1	< 0.1%
1.4126851 × 10¹⁹	1	< 0.1%
1.41268411 × 10¹⁹	1	< 0.1%
1.412683808 × 10¹⁹	1	< 0.1%
1.412680509 × 10¹⁹	1	< 0.1%
1.412674874 × 10¹⁹	1	< 0.1%
1.412674655 × 10¹⁹	1	< 0.1%
1.41267405 × 10¹⁹	1	< 0.1%

class
Categorical

High correlation

Distinct	3
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.4 KiB

GALAXY	59445
STAR	21594
QSO	18961

Length

Max length	6
Median length	6
Mean length	4.99929
Min length	3

Characters and Unicode

Total characters	499929
Distinct characters	10
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	GALAXY
2nd row	GALAXY
3rd row	GALAXY
4th row	GALAXY
5th row	GALAXY

Common Values

Value	Count	Frequency (%)
GALAXY	59445	59.4%
STAR	21594	21.6%
QSO	18961	19.0%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
galaxy	59445	59.4%
star	21594	21.6%
qso	18961	19.0%

Most occurring characters

Value	Count	Frequency (%)
A	140484	28.1%
G	59445	11.9%
L	59445	11.9%
X	59445	11.9%
Y	59445	11.9%
S	40555	8.1%
T	21594	4.3%
R	21594	4.3%
Q	18961	3.8%
O	18961	3.8%

Most occurring categories

Value	Count	Frequency (%)
(unknown)	499929	100.0%

Most frequent character per category

(unknown)

Value	Count	Frequency (%)
A	140484	28.1%
G	59445	11.9%
L	59445	11.9%
X	59445	11.9%
Y	59445	11.9%
S	40555	8.1%
T	21594	4.3%
R	21594	4.3%
Q	18961	3.8%
O	18961	3.8%

Most occurring scripts

Value	Count	Frequency (%)
(unknown)	499929	100.0%

Most frequent character per script

(unknown)

Value	Count	Frequency (%)
A	140484	28.1%
G	59445	11.9%
L	59445	11.9%
X	59445	11.9%
Y	59445	11.9%
S	40555	8.1%
T	21594	4.3%
R	21594	4.3%
Q	18961	3.8%
O	18961	3.8%

Most occurring blocks

Value	Count	Frequency (%)
(unknown)	499929	100.0%

Most frequent character per block

(unknown)

Value	Count	Frequency (%)
A	140484	28.1%
G	59445	11.9%
L	59445	11.9%
X	59445	11.9%
Y	59445	11.9%
S	40555	8.1%
T	21594	4.3%
R	21594	4.3%
Q	18961	3.8%
O	18961	3.8%

redshift
Real number (ℝ)

High correlation

Distinct	99295
Distinct (%)	99.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.5766608

Minimum	-0.009970667
Maximum	7.011245
Zeros	412
Zeros (%)	0.4%
Negative	13724
Negative (%)	13.7%
Memory size	781.4 KiB

Quantile statistics

Minimum	-0.009970667
5-th percentile	-0.00032605719
Q1	0.054516845
median	0.42417325
Q3	0.70415432
95-th percentile	2.1877278
Maximum	7.011245
Range	7.0212157
Interquartile range (IQR)	0.64963748

Descriptive statistics

Standard deviation	0.73070728
Coefficient of variation (CV)	1.2671353
Kurtosis	9.9729155
Mean	0.5766608
Median Absolute Deviation (MAD)	0.34491005
Skewness	2.5236063
Sum	57666.08
Variance	0.53393312
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	412	0.4%
7.011245	6	< 0.1%
0.004153254	4	< 0.1%
0.004153253	3	< 0.1%
-0.004136076	3	< 0.1%
0.6291372	3	< 0.1%
0.471631	2	< 0.1%
0.8155696	2	< 0.1%
1.054235	2	< 0.1%
0.7730237	2	< 0.1%
Other values (99285)	99561	99.6%

Value	Count	Frequency (%)
-0.009970667	1	< 0.1%
-0.007351653	1	< 0.1%
-0.006863183	1	< 0.1%
-0.006055369	1	< 0.1%
-0.005675106	1	< 0.1%
-0.004712832	1	< 0.1%
-0.004254519	1	< 0.1%
-0.004136078	1	< 0.1%
-0.004136076	3	< 0.1%
-0.004020985	1	< 0.1%

Value	Count	Frequency (%)
7.011245	6	< 0.1%
7.011103	1	< 0.1%
7.010295	1	< 0.1%
7.010272	1	< 0.1%
7.010263	1	< 0.1%
7.009989	1	< 0.1%
7.0094	1	< 0.1%
7.008322	1	< 0.1%
7.007396	1	< 0.1%
7.00387	2	< 0.1%

plate
Real number (ℝ)

High correlation

Distinct	6284
Distinct (%)	6.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5137.0097

Minimum	266
Maximum	12547
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	781.4 KiB

Quantile statistics

Minimum	266
5-th percentile	727
Q1	2526
median	4987
Q3	7400.25
95-th percentile	10431
Maximum	12547
Range	12281
Interquartile range (IQR)	4874.25

Descriptive statistics

Standard deviation	2952.3034
Coefficient of variation (CV)	0.57471244
Kurtosis	-0.90475111
Mean	5137.0097
Median Absolute Deviation (MAD)	2425
Skewness	0.1984718
Sum	5.1370097 × 10⁸
Variance	8716095.1
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
6301	98	0.1%
7699	97	0.1%
7407	96	0.1%
7147	95	0.1%
6516	94	0.1%
5185	88	0.1%
7697	83	0.1%
7450	80	0.1%
10431	79	0.1%
7701	78	0.1%
Other values (6274)	99112	99.1%

Value	Count	Frequency (%)
266	14	< 0.1%
267	12	< 0.1%
268	1	< 0.1%
269	2	< 0.1%
271	3	< 0.1%
272	2	< 0.1%
273	1	< 0.1%
274	2	< 0.1%
276	1	< 0.1%
277	2	< 0.1%

Value	Count	Frequency (%)
12547	13	< 0.1%
12545	14	< 0.1%
12544	26	< 0.1%
12533	8	< 0.1%
12531	30	< 0.1%
12527	17	< 0.1%
12525	31	< 0.1%
11704	2	< 0.1%
11678	5	< 0.1%
11677	6	< 0.1%

MJD
Real number (ℝ)

High correlation

Distinct	2180
Distinct (%)	2.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	55588.647

Minimum	51608
Maximum	58932
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	781.4 KiB

Quantile statistics

Minimum	51608
5-th percentile	52337.45
Q1	54234
median	55868.5
Q3	56777
95-th percentile	58200
Maximum	58932
Range	7324
Interquartile range (IQR)	2543

Descriptive statistics

Standard deviation	1808.4842
Coefficient of variation (CV)	0.032533338
Kurtosis	-0.77315233
Mean	55588.647
Median Absolute Deviation (MAD)	1256.5
Skewness	-0.38185318
Sum	5.5588648 × 10⁹
Variance	3270615.2
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
56625	249	0.2%
58162	228	0.2%
56658	217	0.2%
56390	216	0.2%
56385	201	0.2%
57574	200	0.2%
58428	193	0.2%
56074	190	0.2%
56722	188	0.2%
55863	186	0.2%
Other values (2170)	97932	97.9%

Value	Count	Frequency (%)
51608	12	< 0.1%
51609	7	< 0.1%
51613	4	< 0.1%
51615	4	< 0.1%
51630	14	< 0.1%
51633	1	< 0.1%
51637	6	< 0.1%
51658	2	< 0.1%
51662	7	< 0.1%
51663	11	< 0.1%

Value	Count	Frequency (%)
58932	61	0.1%
58931	8	< 0.1%
58930	31	< 0.1%
58928	39	< 0.1%
58895	2	< 0.1%
58543	36	< 0.1%
58526	36	< 0.1%
58523	36	< 0.1%
58522	40	< 0.1%
58515	39	< 0.1%

fiber_ID
Real number (ℝ)

Distinct	1000
Distinct (%)	1.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	449.31274

Minimum	1
Maximum	1000
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	781.4 KiB

Quantile statistics

Minimum	1
5-th percentile	46
Q1	221
median	433
Q3	645
95-th percentile	926
Maximum	1000
Range	999
Interquartile range (IQR)	424

Descriptive statistics

Standard deviation	272.4984
Coefficient of variation (CV)	0.60647825
Kurtosis	-0.98072189
Mean	449.31274
Median Absolute Deviation (MAD)	212
Skewness	0.22971912
Sum	44931274
Variance	74255.38
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
637	159	0.2%
105	158	0.2%
597	158	0.2%
611	154	0.2%
321	154	0.2%
621	151	0.2%
564	149	0.1%
409	148	0.1%
563	148	0.1%
571	146	0.1%
Other values (990)	98475	98.5%

Value	Count	Frequency (%)
1	86	0.1%
2	114	0.1%
3	135	0.1%
4	87	0.1%
5	117	0.1%
6	108	0.1%
7	117	0.1%
8	101	0.1%
9	108	0.1%
10	100	0.1%

Value	Count	Frequency (%)
1000	81	0.1%
999	88	0.1%
998	72	0.1%
997	100	0.1%
996	70	0.1%
995	63	0.1%
994	57	0.1%
993	78	0.1%
992	64	0.1%
991	59	0.1%

	MJD	alpha	cam_col	class	delta	fiber_ID	field_ID	g	i	plate	r	redshift	run_ID	spec_obj_ID	u	z
MJD	1.000	0.000	-0.009	0.332	0.148	0.234	-0.040	0.581	0.681	0.992	0.674	0.490	0.200	0.992	0.406	0.660
alpha	0.000	1.000	0.011	0.140	0.143	0.025	-0.063	-0.027	-0.033	-0.012	-0.034	-0.021	-0.014	-0.012	-0.007	-0.033
cam_col	-0.009	0.011	1.000	0.044	0.031	0.133	-0.017	0.006	0.005	-0.008	0.006	-0.004	-0.053	-0.008	0.007	0.005
class	0.332	0.140	0.044	1.000	0.110	0.081	0.049	0.004	0.279	0.326	0.222	0.583	0.134	0.326	0.004	0.004
delta	0.148	0.143	0.031	0.110	1.000	0.031	-0.115	-0.014	0.007	0.133	-0.003	0.025	-0.302	0.133	-0.028	0.007
fiber_ID	0.234	0.025	0.133	0.081	0.031	1.000	-0.009	0.205	0.202	0.234	0.208	0.156	0.051	0.234	0.178	0.194
field_ID	-0.040	-0.063	-0.017	0.049	-0.115	-0.009	1.000	-0.011	-0.012	-0.036	-0.012	0.003	0.049	-0.036	-0.011	-0.011
g	0.581	-0.027	0.006	0.004	-0.014	0.205	-0.011	1.000	0.790	0.582	0.906	0.510	0.122	0.582	0.850	0.717
i	0.681	-0.033	0.005	0.279	0.007	0.202	-0.012	0.790	1.000	0.684	0.958	0.582	0.112	0.684	0.563	0.978
plate	0.992	-0.012	-0.008	0.326	0.133	0.234	-0.036	0.582	0.684	1.000	0.676	0.492	0.207	1.000	0.406	0.664
r	0.674	-0.034	0.006	0.222	-0.003	0.208	-0.012	0.906	0.958	0.676	1.000	0.573	0.121	0.676	0.689	0.910
redshift	0.490	-0.021	-0.004	0.583	0.025	0.156	0.003	0.510	0.582	0.492	0.573	1.000	0.072	0.492	0.331	0.570
run_ID	0.200	-0.014	-0.053	0.134	-0.302	0.051	0.049	0.122	0.112	0.207	0.121	0.072	1.000	0.207	0.106	0.105
spec_obj_ID	0.992	-0.012	-0.008	0.326	0.133	0.234	-0.036	0.582	0.684	1.000	0.676	0.492	0.207	1.000	0.406	0.664
u	0.406	-0.007	0.007	0.004	-0.028	0.178	-0.011	0.850	0.563	0.406	0.689	0.331	0.106	0.406	1.000	0.495
z	0.660	-0.033	0.005	0.004	0.007	0.194	-0.011	0.717	0.978	0.664	0.910	0.570	0.105	0.664	0.495	1.000

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

	alpha	delta	u	g	r	i	z	run_ID	rerun_ID	cam_col	field_ID	spec_obj_ID	class	redshift	plate	MJD	fiber_ID
0	135.689107	32.494632	23.87882	22.27530	20.39501	19.16573	18.79371	3606	301	2	79	6.543777e+18	GALAXY	0.634794	5812	56354	171
1	144.826101	31.274185	24.77759	22.83188	22.58444	21.16812	21.61427	4518	301	5	119	1.176014e+19	GALAXY	0.779136	10445	58158	427
2	142.188790	35.582444	25.26307	22.66389	20.60976	19.34857	18.94827	3606	301	2	120	5.152200e+18	GALAXY	0.644195	4576	55592	299
3	338.741038	-0.402828	22.13682	23.77656	21.61162	20.50454	19.25010	4192	301	3	214	1.030107e+19	GALAXY	0.932346	9149	58039	775
4	345.282593	21.183866	19.43718	17.58028	16.49747	15.97711	15.54461	8102	301	3	137	6.891865e+18	GALAXY	0.116123	6121	56187	842
5	340.995121	20.589476	23.48827	23.33776	21.32195	20.25615	19.54544	8102	301	3	110	5.658977e+18	QSO	1.424659	5026	55855	741
6	23.234926	11.418188	21.46973	21.17624	20.92829	20.60826	20.42573	7773	301	2	462	1.246262e+19	QSO	0.586455	11069	58456	113
7	5.433176	12.065186	22.24979	22.02172	20.34126	19.48794	18.84999	7773	301	2	346	6.961443e+18	GALAXY	0.477009	6183	56210	15
8	200.290475	47.199402	24.40286	22.35669	20.61032	19.46490	18.95852	3716	301	5	108	7.459285e+18	GALAXY	0.660012	6625	56386	719
9	39.149691	28.102842	21.74669	20.03493	19.17553	18.81823	18.65422	5934	301	4	122	2.751763e+18	STAR	-0.000008	2444	54082	232

	alpha	delta	u	g	r	i	z	run_ID	rerun_ID	cam_col	field_ID	spec_obj_ID	class	redshift	plate	MJD	fiber_ID
99990	143.414774	26.731108	23.79655	22.41332	20.36012	19.33964	18.74413	4569	301	1	213	6.525784e+18	GALAXY	0.555789	5796	56274	247
99991	146.898055	27.818094	26.22899	21.84820	20.47138	19.60049	18.94726	4569	301	1	234	6.523611e+18	GALAXY	0.550025	5794	56282	535
99992	129.862762	14.574312	25.82234	24.02722	21.43137	20.13085	19.66464	5137	301	3	111	5.066775e+18	GALAXY	0.587944	4500	55543	819
99993	0.740551	-9.184243	23.13172	23.18506	21.52854	20.26975	20.11383	1740	301	5	27	8.069569e+18	GALAXY	0.617036	7167	56604	889
99994	317.246996	-0.682254	20.96526	19.81625	19.34186	19.14711	19.05790	4187	301	2	64	1.154061e+18	GALAXY	0.175206	1025	53239	51
99995	39.620709	-2.594074	22.16759	22.97586	21.90404	21.30548	20.73569	7778	301	2	581	1.055431e+19	GALAXY	0.000000	9374	57749	438
99996	29.493819	19.798874	22.69118	22.38628	20.45003	19.75759	19.41526	7917	301	1	289	8.586351e+18	GALAXY	0.404895	7626	56934	866
99997	224.587407	15.700707	21.16916	19.26997	18.20428	17.69034	17.35221	5314	301	4	308	3.112008e+18	GALAXY	0.143366	2764	54535	74
99998	212.268621	46.660365	25.35039	21.63757	19.91386	19.07254	18.62482	3650	301	4	131	7.601080e+18	GALAXY	0.455040	6751	56368	470
99999	196.896053	49.464643	22.62171	21.79745	20.60115	20.00959	19.28075	3650	301	4	60	8.343152e+18	GALAXY	0.542944	7410	57104	851

Overview

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

(unknown)

Most occurring scripts

Most frequent character per script

(unknown)

Most occurring blocks

Most frequent character per block

(unknown)

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

(unknown)

Most occurring scripts

Most frequent character per script

(unknown)

Most occurring blocks

Most frequent character per block

(unknown)

Interactions

Correlations

Missing values

Sample

Overview

Variables

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

(unknown)

Most occurring scripts

Most frequent character per script

(unknown)

Most occurring blocks

Most frequent character per block

(unknown)

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

(unknown)

Most occurring scripts

Most frequent character per script

(unknown)

Most occurring blocks

Most frequent character per block

(unknown)

Interactions

Correlations

Missing values

Sample